close reading
Dear referees and chairs, 1 We would like to thank all referees for their close reading of the manuscript
We would like to thank all referees for their close reading of the manuscript. The second reason to include the multiclass setting is the bandit setting. For an overview of the different bounds we provided Table 1. The parameters can be found in Section 2. Importantly, Gaptron often is on par with, if not better than slower algorithms such as ONS. This lower bound does not apply to our setting, where the learner suffers the zero-one loss.
There's a Literacy Crisis. One Classroom Solution Should Be Obvious.
You can't get better at reading until you care about a text. We are English professors who stumbled into a debate about high school pedagogy. We wrote a book to help college instructors teach close reading, the fundamental skill of literary studies. And then, well before it was published, we started hearing from education scholars training high school teachers, and high school teachers themselves, who had caught wind of the book through advance essays and word of mouth. They were interested in how we describe close reading, the tools we provide for teaching it, and the claim we make for its importance.
KRISTEVA: Close Reading as a Novel Task for Benchmarking Interpretive Reasoning
Sui, Peiqi, Rodriguez, Juan Diego, Laban, Philippe, Murphy, Dean, Dexter, Joseph P., So, Richard Jean, Baker, Samuel, Chaudhuri, Pramit
Each year, tens of millions of essays are written and graded in college-level English courses. Students are asked to analyze literary and cultural texts through a process known as close reading, in which they gather textual details to formulate evidence-based arguments. Despite being viewed as a basis for critical thinking and widely adopted as a required element of university coursework, close reading has never been evaluated on large language models (LLMs), and multi-discipline benchmarks like MMLU do not include literature as a subject. To fill this gap, we present KRISTEVA, the first close reading benchmark for evaluating interpretive reasoning, consisting of 1331 multiple-choice questions adapted from classroom data. With KRISTEVA, we propose three progressively more difficult sets of tasks to approximate different elements of the close reading process, which we use to test how well LLMs may seem to understand and reason about literary works: 1) extracting stylistic features, 2) retrieving relevant contextual information from parametric knowledge, and 3) multi-hop reasoning between style and external contexts. Our baseline results find that, while state-of-the-art LLMs possess some college-level close reading competency (accuracy 49.7% - 69.7%), their performances still trail those of experienced human evaluators on 10 out of our 11 tasks.
- North America > United States > Minnesota > Hennepin County > Minneapolis (0.14)
- Asia > Thailand > Bangkok > Bangkok (0.04)
- North America > United States > Illinois > Cook County > Chicago (0.04)
- (14 more...)
- Instructional Material (1.00)
- Research Report > New Finding (0.87)
CREDAL: Close Reading of Data Models
Fletcher, George, Nahurna, Olha, Prytula, Matvii, Stoyanovich, Julia
Data models are necessary for the birth of data and of any data-driven system. Indeed, every algorithm, every machine learning model, every statistical model, and every database has an underlying data model without which the system would not be usable. Hence, data models are excellent sites for interrogating the (material, social, political, ...) conditions giving rise to a data system. Towards this, drawing inspiration from literary criticism, we propose to closely read data models in the same spirit as we closely read literary artifacts. Close readings of data models reconnect us with, among other things, the materiality, the genealogies, the techne, the closed nature, and the design of technical systems. While recognizing from literary theory that there is no one correct way to read, it is nonetheless critical to have systematic guidance for those unfamiliar with close readings. This is especially true for those trained in the computing and data sciences, who too often are enculturated to set aside the socio-political aspects of data work. A systematic methodology for reading data models currently does not exist. To fill this gap, we present the CREDAL methodology for close readings of data models. We detail our iterative development process and present results of a qualitative evaluation of CREDAL demonstrating its usability, usefulness, and effectiveness in the critical study of data.
- North America > United States > New York (0.04)
- Europe > Ukraine > Lviv Oblast > Lviv (0.04)
- North America > United States > Wisconsin > Dane County > Madison (0.04)
- (5 more...)
- Research Report (1.00)
- Personal > Interview (0.93)
- Information Technology > Information Management (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning (1.00)
- Information Technology > Artificial Intelligence > Cognitive Science > Problem Solving (0.46)
Hybrid Intelligence for Digital Humanities
In this paper, we explore the synergies between Digital Humanities (DH) as a discipline and Hybrid Intelligence (HI) as a research paradigm. In DH research, the use of digital methods and specifically that of Artificial Intelligence is subject to a set of requirements and constraints. We argue that these are well-supported by the capabilities and goals of HI. Our contribution includes the identification of five such DH requirements: Successful AI systems need to be able to 1) collaborate with the (human) scholar; 2) support data criticism; 3) support tool criticism; 4) be aware of and cater to various perspectives and 5) support distant and close reading. We take the CARE principles of Hybrid Intelligence (collaborative, adaptive, responsible and explainable) as theoretical framework and map these to the DH requirements. In this mapping, we include example research projects. We finally address how insights from DH can be applied to HI and discuss open challenges for the combination of the two disciplines.
- Europe > Netherlands > North Holland > Amsterdam (0.04)
- North America > United States > New York > New York County > New York City (0.04)
- North America > Canada > Quebec > Montreal (0.04)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Natural Language (1.00)
- Information Technology > Artificial Intelligence > Issues > Social & Ethical Issues (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.93)
Is AI Art Really Art?
Maureen F. McHugh's short story collection After the Apocalypse was merely prescient when published in 2011, but it appears positively prophetic a decade later with its narratives about respiratory virus pandemics, frayed social connections, and increased political violence. Few of her tales, however, are as haunting as "The Kingdom of the Blind," which will perhaps prove to be the most visionary of McHugh's stories. "The Kingdom of the Blind" takes as its subject artificial intelligence, grappling with the possibility that any consciousness which arises from soldering board and circuitry may be so alien that it's scarcely recognizable to us as a consciousness in the first place. The emergent process of consciousness as it develops in this AI is inscrutable and totally different from anything which resembles human thinking, posing a difficulty for the computer scientists who attempt to communicate with it. In sparse, elegant, and beautiful prose, McHugh's story describes how a massive interconnected computer program evolves a quality that could be described as "consciousness," and yet how to describe the thought which animates this being is impossible.
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (0.35)
- Information Technology > Artificial Intelligence > Natural Language > Chatbot (0.35)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning > Generative AI (0.32)
Plotting Markson's 'Mistress'
Conor, Kelleher, Keane, Mark T.
The post-modern novel 'Wittgenstein's Mistress' by David Markson (1988) presents the reader with a very challenging non linear narrative, that itself appears to one of the novel's themes. We present a distant reading of this work designed to complement a close reading of it by David Foster Wallace (1990). Using a combination of text analysis, entity recognition and networks, we plot repetitive structures in the novel's narrative relating them to its critical analysis.
Machine learning can offer new tools, fresh insights for the humanities
Truly revolutionary political transformations are naturally of great interest to historians, and the French Revolution at the end of the 18th century is widely regarded as one of the most influential, serving as a model for building other European democracies. A paper published last summer in the Proceedings of the National Academy of Sciences, offers new insight into how the members of the first National Constituent Assembly hammered out the details of this new type of governance. Specifically, rhetorical innovations by key influential figures (like Robespierre) played a critical role in persuading others to accept what were, at the time, audacious principles of governance, according to co-author Simon DeDeo, a former physicist who now applies mathematical techniques to the study of historical and current cultural phenomena. And the cutting-edge machine learning methods he developed to reach that conclusion are now being employed by other scholars of history and literature. As more and more archives are digitized, scholars are applying various analytical tools to those rich datasets, such as Google N-gram, Bookworm, and WordNet.
- North America > United States > Indiana (0.05)
- North America > United States > Illinois (0.05)
- North America > Canada > Quebec > Montreal (0.05)
- Europe > France (0.05)
Machine learning can offer new tools, fresh insights for the humanities
Truly revolutionary political transformations are naturally of great interest to historians, and the French Revolution at the end of the 18th century is widely regarded as one of the most influential, serving as a model for building other European democracies. A paper published last summer in the Proceedings of the National Academy of Sciences, offers new insight into how the members of the first National Constituent Assembly hammered out the details of this new type of governance. Specifically, rhetorical innovations by key influential figures (like Robespierre) played a critical role in persuading others to accept what were, at the time, audacious principles of governance, according to co-author Simon DeDeo, a former physicist who now applies mathematical techniques to the study of historical and current cultural phenomena. And the cutting-edge machine learning methods he developed to reach that conclusion are now being employed by other scholars of history and literature. As more and more archives are digitized, scholars are applying various analytical tools to those rich datasets, such as Google N-gram, Bookworm, and WordNet.
- North America > United States > Indiana (0.05)
- North America > United States > Illinois (0.05)
- North America > Canada > Quebec > Montreal (0.05)
- Europe > France (0.05)